Multi-Modal and Modality Specific Error Handling in the GEMINI Project
نویسندگان
چکیده
GEMINI (Generic Environment for Multilingual Interactive Natural Interfaces) is an EC-funded research project which started in April 2002. The goal of GEMINI is to provide a flexible platform for the generation of applications, able to produce multi-modal and multilingual dialogue interfaces to databases with a minimum of human effort. All description models which are generated by the tools of the platform are based on our newly designed XML-based description language called GDialogXML (Gemini Dialog XML). It is an abstract dialogue description language, which is flexible enough to account for both modality independent and modality specific features of the target language, i.e. VoiceXML or xHTML. The platform will generate high-quality, state-of-the-art applications, e.g. a speech application that includes mixed-initiative dialogues and sophisticated error handling. In this paper, we focus on the treatment of error handling for speech. Error handling for the web will be done in a future stage of the project.
منابع مشابه
XML-Based Dialogue Descriptions in the GEMINI Project
GEMINI (Generic Environment for Multilingual Interactive Natural Interfaces) is an EC funded research project. The goal of GEMINI is to provide a flexible platform for the generation of dialogue applications, able to produce multi-modal and multilingual dialogue interfaces to databases with a minimum of human effort. This platform consists of a toolset supporting all steps of application genera...
متن کاملHybridization of Facial Features and Use of Multi Modal Information for 3D Face Recognition
Despite of achieving good performance in controlled environment, the conventional 3D face recognition systems still encounter problems in handling the large variations in lighting conditions, facial expression and head pose The humans use the hybrid approach to recognize faces and therefore in this proposed method the human face recognition ability is incorporated by combining global and local ...
متن کاملFloor Control Arbitration for a Hybrid Voice/Text Web-board
We have built a hybrid voice/text web–board that utilizes floor control for handling resources such as microphone and interface events. The aim of this research is to determine the most appropriate floor control mechanism for a hybrid communication tool that allows conventional text and audio users to communicate with one another using a common interface. Research on floor control mechanisms pr...
متن کاملTowards a taxonomy of error-handling strategies in recognition-based multi-modal human-computer interfaces
In this paper, we survey the different types of error-handling strategies that have been described in the literature on recognition-based human–computer interfaces. A wide range of strategies can be found in spoken human–machine dialogues, handwriting systems, and multi-modal natural interfaces. We then propose a taxonomy for classifying errorhandling strategies that has the following three dim...
متن کاملThe Acquisition and Development of the Concepts of English Modality Through Metaphors
The current study attempted to investigate the effect of Systemic-Theoretical Instruction (STI) on English-language learners’ acquisition of the concepts of modal verbs through exploiting metaphors. To this end, the effect of the main treatment of the study, i.e. Concept-Based Instruction (CBI) was investigated through conceptual metaphors, in two gender (male vs. female) ...
متن کامل